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Method for determining the permitted working range of a neural network 
BACKGROUND OF THE INVENTION 

1. Field of the Invention 

[0001] The invention relates to a method for checking whether an input data record is in the 
5 permitted working range of a neural network, and to a corresponding computer program product 
and system. 

2. Description of the Related Art 

[0002] A plurality of application possibilities for neural networks are known from the prior art. 

10 Neural networks are used for data-driven model formation, for example for physical, biological, 
chemical and technical processes and systems, cf. Babel W.: "Einsatzmoglichkeiten neuronaler 
Netze in der Industrie: Mustererkennung anhand uberwachter Lernverfahren - mit Beispielen aus 
der Verkehrs- und Medizintechnik"[translation of title: "Possibilities of use of neural networks in 
industry: pattern recognition using monitored learning methods - with examples from 

15 transportation and medicine technology"], Expert Verlag, Renningen-Malmsheim, 1997. In 
particular, the fields of use of neural networks include process optimization, image processing, 
pattern recognition, robot control and medicine technology. 

[0003] Before a neural network can be used for predictive or optimization purposes, it must be 
20 trained. This usually involves adapting the weights of the neurons by means of an iterative 
method using training data, cf. Barmann F.: "Prozessmodellierung: Modellierung von 
Kontianlagen mit neuronalen Netzen" [translation of title: "Process modelling: modelling of 
continuous systems with neural networks"], Internet page NN-Tool, www.baermann.de and 
Barmann F.: "Neuronale Netze". Skriptum zur Vorlesung, FH-Gelsenkirchen, Fachbereich 
25 Physikalische Technik, Fachgebiet Neuroinformatik [translation of title: "Neural networks". 
Lecture paper. Technical University of Gelsenkirchen, Department of Physico-Technology, 
Subject area of neurocomputing], 1998. 

[0004] The so-called back propagation method is particularly suitable for training a neural 
30 network. A further approach is implemented in the program "NN-Tool 2000". This program is 
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commercially available from Professor Frank Barmann, Technical University of Gelsenkirchen, 
Department of Physical Technology. The corresponding training method is also described in the 
publication "Neural Network", Volume 5, pages 139 to 144, 1992, "On a class of efficient 
learning algorithms for neural networks", Frank Barmann, Friedrich Biegler-Konig. 

5 

[0005] DE 195 31 967 discloses a method for training a neural network with the non- 
deterministic behaviour of a technical system. The neural network is integrated here into a 
control loop in such a way that the neural network outputs, as output variable, a manipulated 
variable to the technical system, and the technical system generates a controlled variable from 
10 the manipulated variable supplied by the neural network and said controlled variable is fed to the 
neural network as an input variable. Noise with a known noise distribution is superimposed on 
the manipulated variable before it is fed to the technical system. Further methods for training 
neural networks are known from DE 692 28 412 T2 and DE 198 38 654 CI. 

15 [0006] In addition, a method for estimating the confidence level of the prediction which is output , 
by a neural network is known from the prior art: Protzel P., Kindermann L., Tagscherer M., 
Lewandowski A. "Abschatzung der Vertrauenswiirdigkeit von Neuronalen Netzprognosen bei 
der Prozessoptimierung [translated title: "Estimating the confidence level of neural network 
predictions when optimizing processes"], VDI Berichte [Reports] No. 1526, 2000. 

20 EP 0 762 245 Bl also discloses a method for recognizing faulty predictions in a neural-model- 
supported or neural process control system. 

[0007] A common disadvantage of these methods known from the prior art is that they can only 
permit conclusions to be drawn about the sensitivity, in terms of variations of the training data, 
25 of the model which is made available by the neural network. However, it is thus not possible to 
draw conclusions about the confidence level of a prediction which is made by the neural 
network. 

[0008] F. Barmann; Handbuch zu NN-Tool 98 [translated title: "Neural Network Tool Manual"], 
30 1998, discloses an approach in which it is attempted to estimate the prediction error at a specific 
point using the known prediction error at adjacent data points. 
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[0009] All these methods have in common the fact that it is not possible to draw a conclusion as 
to whether an input data record is at all in the permitted working range of the neural network. 
However, an incorrect estimation is possible only in this case. 

5 

[0010] The invention is therefore based on the object of providing a method which makes it 
possible to check whether an input data record is in the permitted working range of a neural 
network. In addition, the invention is based on the object of providing a corresponding computer 
program product. 

10 

[0011] The object on which the invention is based is achieved in each case with the features of 
the independent patent claims. Preferred embodiments of the invention are given in the 
dependent patent claims. 

1 5 SUMMARY OF THE INVENTION 

[0012] The present invention makes it possible to check an input data record for a neural 
network to determine whether it is in the permitted working range of the neural network. The 
invention is based on the realization that structural information is not input into neural networks 
but instead only training input data records are used which have been, for example, obtained by 
20 measuring means. Due to this recognition, such models can provide trustworthy predictions only 
in the areas in which the models have been trained. 

[0013] Between the given training data points it is possible to interpolate very efficiently using 
such models. However, in contrast to corresponding rigorous models, data-driven models cannot 
25 extrapolate, or can extrapolate only to a very restricted degree. Therefore, in particular for 
monitoring and/or controlling critical applications, it is advantageous that it is possible to check 
whether the model used is utilized in the permitted working range. 

[0014] This applies to a greater degree also to hybrid models in which a plurality of neural 
30 networks is connected to rigorous models. Although hybrid models are capable of extrapolation 
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as an overall model, the interpolation area must be checked for each individual data-driven 
subcomponent, that is to say, for the neural networks which are contained in the hybrid model. 

[0015] According to the invention, the working range of a neural network is defined by the 
5 convex envelope formed by the training input data records of the neural network. For example, a 
neural network has a number of a inputs and a number of b outputs. To form models, data 
records for the a input parameters and the b output parameters are acquired by measuring means. 

[0016] If, for example, a model is to be formed for a manufacturing process, the input 
10 parameters can be data relating to the materials used, their composition and/or parameters of the 
production system, for example pressures, temperatures and the like. The resulting product 
properties, for example, are then measured for the output parameters. In this way, training data 
records which each contain a set of input parameters and associated output parameters are 
obtained. The neural network is trained using these training data records, that is to say the 
1 5 weightings of the neurons are adapted iteratively. 

[0017] According to one preferred embodiment of the invention, the following definition of the 
convex envelope is applied as a way of defining the permitted working range: 

20 [0018] P is assumed to be a given, finite set of n points p\ 9 ... 9 p n . The points p t (for i'=l,...,/i) of the 
set P are formed by means of the training input data records with which the neural network has 
been trained. A point x, that is to say a specific input data record, is associated with the convex 
envelope which is formed by P and is referred to as conv(P) if it yields real numbers >*i,...,/l„ > 0 
where A\ = 1 so that A\p\ +...+ X n p n = x for pieP (for i=l,...,n). (On the theory of convex 

25 envelopes, see also: Dieter Jungnickel: "Optimierungsmethoden" [translated title: "Optimization 
methods"]; Springer, Heidelberg; 1999; ISBN: 3540660577). 

[0019] According to one preferred embodiment of the invention, the direct surroundings of the 
convex envelope are also considered as a permitted working range as neural networks can also 
30 supply appropriate results in the direct vicinity of the convex envelope. However, the working 
range is alternatively restricted directly to the convex envelope as it is not possible to draw a 
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precise conclusion as to where the "direct vicinity" ends. In particular for critical applications 
which relate, for example, to continuous production, the working range is therefore restricted to 
the interior of the convex envelope, the external surroundings in the direct vicinity of the convex 
envelope being excluded from the working range. 

5 

[0020] In the practical application, in particular in time-critical applications, it is of particular 
significance to use efficient procedures in order to determine whether an input data record is in 
the permitted working range of the associated neural network. 

10 [0021] The algorithms Quickhull (see C.B. Barber, D.P. Dobkin and H.T. Huhdanpaa: "The 
Quickhull Algorithm for Convex Hulls"; ACM Transaction Mathematical Software; Vol. 22, No. 
4; 1996; p 469-483, Simplex Algorithm) as well as the simplex algorithm (see, for example, 
Dieter Jungnickel: "Optimierungsmethoden" [translated title: "Optimization methods"]; 
Springer, Heidelberg; 1999; ISBN: 3540660577) are known per se from the literature. These 

15 methods are inefficient in highly dimensional spaces (i.e. input dimensions greater than 9) 
because they require extremely long computing times and fail on commercially available 
computers due to the memory requirement. On the other hand, in preferred embodiments of the 
invention it is possible to have recourse to three basically different, very efficient methods. 

20 [0022] According to one preferred embodiment of the invention, firstly a simplex composed of a 
number of d + 1 non-collinear points from the set P is formed in order to check whether an input 
data record is in the convex envelope, d being the dimension of the space formed by P. A point is 
then selected from the interior of this simplex. To do this, it is possible to use, for example, the 
center of gravity of the simplex which is calculated from the vertices of the simplex. This point is 

25 referred to below by xo. 

[0023] In the next step, the path [x, jc 0 ] between the point jc defined by the input data record and 
the point x 0 selected from the simplex is considered. It is then checked whether there is an 
intersection point of the path [jc, x 0 ] with a facet of the simplex. The facets are the "side faces" of 
30 the simplex. 



[0024] If there is no such intersection point, this means that the point x is in the interior of the 
convex envelope. 

[0025] If the opposite is the case, this results in the point jc being outside the simplex. However, 
5 this does not yet answer the question as to whether the point x is inside or outside the convex 
envelope. It is therefore checked whether it is possible to form a further simplex from d + 1 non- 
collinear points from the set P in such a way that the further simplex contains the intersection 
point with the facet and a section of the path [jc, jco]. 

10 [0026] If this is not possible, the result of this is that the point jc is outside the convex envelope 
(Caratheodory's set). If such a simplex can be formed, the check is carried out again to 
determine whether an intersection point of the path [jc, jco] exists with a facet of the further 
simplex. As there is only a finite number of points in P after a finite number of iterations, this 
method indicates whether or not jc is in the convex envelope as all the simplices can be checked 

15 successively. 

[0027] According to one preferred embodiment of the invention, the check to determine whether 
it is possible to form a further simplex which contains a section of the path [jc, jco] is carried out 
as follows: firstly, the vertices of the facet which is intersected by the path [jc, jco] are determined. 
20 Then a further point is selected from the set P. This can be any desired point which is not 
associated with the vertices of the facet. 

[0028] A further simplex is then formed on a trial basis from the further point and the vertices. If 
this further simplex which is formed on a trial basis contains a section of the path [jc, jc 0 ], this 
25 further simplex which is formed on a trial basis is used as the simplex for a further iteration of 
the method. 

[0029] If such a section of the path [jc, jco] is not contained in the simplex formed on a trial basis, 
the further point which is selected from P is replaced by another point in order to form a further 
30 simplex on a trial basis, and in order to carry out again the subsequent check to determine 
whether a section of path [jc, jcq] is in the simplex formed on a trial basis. 
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[0030] This method is carried out until either a further simplex has been found or all the points 
which are possible from the set P have been selected without a simplex which fulfils the 
secondary condition of containing a section of the path [jc, xo] having been formed. In this case, 
5 the method ends with the conclusion that it is not possible to form a further simplex which 
contains a section of the path [x 9 xo] 9 that is to say x is outside the convex envelope. 

[0031] According to a further preferred embodiment of the invention, a different geometric 
property of the convex envelope is used. This property is as follows: 

10 

[0032] If there is a hyper-plane through the point x to be investigated so that all the p^P are 
located on one side of the plane, the point x is outside the convex envelope formed by P (set of 
Hahn-Banach). If there is no such plane, the point lies in the interior. 

15 [0033] According to a further preferred embodiment of the invention, in order to answer the 
question as to whether or not a point x is in the convex envelope, it is checked whether the 
equation system given by the analytical definition of the convex envelope can be solved. For this 
purpose, an iterative method is used. 

20 [0034] According to a further preferred embodiment of the invention, a model for checking 
whether an input data record is in a permitted working range of the neural network is positioned 
before a neural network. If the respective system is a system with a plurality of neural networks 
and/or a system with rigorous model components, that is to say a so-called hybrid model, such a 
module is preferably positioned before each neural network of the system. If a plurality of neural 

25 networks is used, these modules can be logically linked to a logic "AND" in order to ensure that 
an input data record is in the permitted working range of all these neural networks. This is 
significant in particular in hybrid models. 

BRIEF DESCRIPTION OF THE DRAWINGS 

30 [0035] In what follows, preferred embodiments of the invention are explained in more detail 
with reference to the drawings, in which: 



8 



Figure 1 



shows a flowchart of a first embodiment of a method for checking whether an 
input data record is in the convex envelope, 



5 Figure 2 shows a development of the method from Figure 1 for determining a further 
simplex, 

Figure 3 shows a further embodiment of a method according to the invention for checking 
whether an input data record is in the convex envelope, 

10 

Figure 4 shows a graphic illustration of the method in Figure 3, 

Figure 5 shows a further embodiment of the method for checking whether an input data 
record is in the convex envelope, based on a check as to whether there is a 
15 solution for the equation system provided by the analytical definition of the 

convex envelope, 

Figure 6 shows a block diagram of an embodiment of a system according to the invention. 



20 DETAILED DESCRIPTION OF THE PRESENTLY PREFERRED EMBODIMENTS 

[0036] Figure 1 illustrates a first embodiment of the method for checking whether an input data 
record is in the convex envelope. This method starts from a point jc 0 in the interior of the convex 
envelope and checks whether the path [jc, jc 0 ] is in the interior of the convex envelope. 

25 [0037] Here, jc is the point which is determined by the input record and it is desired to determine 
whether this point also lies within the interior of the convex envelope. 

[0038] For this purpose it is tested whether the path [jc, jc 0 ] intersects one of the facets of the 
convex envelope. If this is the case, the point jc lies outside. Here, use is made of the geometric 
30 property of the convex envelope that any linear connection between any two points on the 
convex envelope lies completely in the convex envelope. 
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[0039] This method is based on the procedure described below: 

A J-dimensional space R d is assumed, d being the number of non-collinear training input data 
records of the neural network. The set P of points includes all the training input data records with 
5 which the neural network has been trained. This set P of points is therefore contained completely 
in the space R d . In addition, a point xo will be assumed from the interior of the convex envelope 
which is formed by P 9 with a known representation as a convex linear combination of the points 
from P, i.e. there are ^...,^ 0) >0 where ^ 0) +... + ^ 0) =1 and ti® Pl =x 0 . 
According to the set of Caratheodory, the coefficients A, (z=l,...,n) can be selected such that all 
10 are equal to 0 with the exception of In addition, it is assumed jc e R d is a point for which it 
is to be investigated whether or not it lies in the interior of conv(P). 

[0040] It is assumed that [x, xo] is the path between the points x and xo. The known coefficients 
^<°) (/=l v .. 5 n) are then modified in such a way that a linear combination with the new 

15 coefficients yields a point xi which is located on the path [xox]. This procedure is repeated until 
finally the point x is found, or one of the lateral boundaries of the convex envelope is reached. 

[0041] In order to modify the coefficients Xf\ a suitable solution of the following, 
underdetermined, linear equation system is searched for: 

20 

Equation 1 

n 

X e <A = x ~ x o 

i=l 

[0042] Then, a factor c>0 is determined such that Af } + csi > 0 for i = 1,..., n applies. It will then 
25 be assumed that := Af 0 + c£j. Then, x } := A\ l) p { + ... + 7^p n is a convex linear combination for 
a point x\ € conv(P) which is nearer to x than x 0 . If the above-described linear combination in 
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which at maximum d+l coefficients are unequal to 0 has been assumed for x 0 , and if the largest 
possible c is selected, in this way the intersection point of the path [x 0r x] with a facet of the 
simplex which is formed by the points from P which are associated with the coefficients is 
obtained. 

5 

[0043] However, the equation system of the equation 1 cannot be solved in a uniquely defined 
way and a c > 0 that fulfils the abovementioned requirements in order to determine new 
coefficients cannot be found for each solution. 

10 [0044] Furthermore, an iterative method is specified which makes it possible to answer the 
question as to whether a solution of the equation system exists, and thus whether or not the point 
x is in the convex envelope: 

[0045] Initialization step: it is assumed that d is the dimension of the space in which the convex 
15 envelope is located. In order to determine a starting value *o, d random, linearly independent 
points q { p € P for j = 1, are selected. Then, a 

x 0 = W +..- + W econvj^,..,^) 
will be selected as the starting value. Furthermore, we assume i = 0. 

20 

[0046] Iteration step: a (</-l)-dimensional hyper-area is uniquely defined in the R d through the 
points ql° 9 ... 9 q ( J } . This hyper-area will be expanded by adding a further point from the set P to 
form a ^-dimensional simplex. It will now be assumed that q^ e P is the point with the 
property that the longest possible part of the path XiX is in the interior of the simplex q\ i} 9 ... 9 g% . 

25 

[0047] In order to discover this point, it is necessary to solve virtually the same equation system 
repeatedly, which can be carried out efficiently. If it is not possible to find a further vertex of the 
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simplex, the point x is outside the convex envelope and the method is aborted. Otherwise, the 
equation system 

has a uniquely defined solution (€\,...,£d+\) and it is possible to select a c > 0 with the properties 
5 described above. It is then assumed that: 

x m :r= X^y +1) ^y 0 

for j = 1,..., rffl. It is possible to select c in such a way that either one of the A ( j +0 (for j = 1,..., 

d+1) is equal to 0 or c = 1 applies. If the case c = 1 occurs, the point x is in the interior of the 
convex envelope and the method can be terminated. 

10 

[0048] Otherwise, a further iteration step has to be carried out. As points q\ m \... 9 q { j +l) the d 
points will be selected from the set fy\...,q%} in which the respectively associated 
(/=1,..., d+l) is unequal to 0. Then, i is increased by 1. 

15 [0049] If the point x is in the interior of the convex envelope of P 9 the algorithm supplies a 
convex linear combination to represent the point. If the point lies outside, d points through which 
a hyper-plane E is determined, which separates the point set P from the point x, are obtained. 
This means that all the points of the R d which lie on the same side of E as the point x cannot be 
associated with the convex envelope. This can be utilized for a multiple evaluation in order to 

20 speed up the entire evaluation considerably. 
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[0050] One form of implementation of this method is illustrated in Figure 1 : 



[0051] In step 100, an input data record for which a prediction is to be created is input. This 
input data record for the neural network determines a point x. 

5 

[0052] In step 101, a number of d + 1 non-collinear points is selected from the set P. 

[0053] In step 102, the index / is set to zero. In step 103, a simplex Si is formed from the points 
selected in step 101. 

10 

[0054] In step 104, a point x/ is selected from the interior of the simplex Si. The center of gravity 
is calculated, for example, from the vertices of the simplex Si in order to obtain the point x/. 

[0055] In step 105, a path [x/x] is defined between x and x/. 

15 

[0056] In step 106 it is checked whether an intersection point x/+i of the pathfxpr] with a facet of 
the simplex Si is located between x and x/. It is therefore checked whether, starting from x/ on the 
straight line in the direction of x, firstly x or a facet of the simplex Si is reached. 

20 [0057] If there is such an intersection point x/+i of the path [x/x] with a facet of 5/, this means that 
the point x is not within the simplex 5/. If the opposite is the case, in step 107 there is an output 
indicating that x is in the convex envelope, as of course it has been determined that x is in the 
simplex Si, and this is in turn completely inside the convex envelope. 

25 [0058] If, on the other hand, the point x is outside the simplex 5/, in step 108 it is checked 
whether it is possible to find a further simplex Si+\ in P which includes both the intersection point 
x/+i and a section of the straight line g. If this is not possible, in step 109 there is an output 
indicating that x is outside the convex envelope. 

30 [0059] In the opposite case, the index / is increased by one in step 110, and step 106 is carried 
out again with respect to the further simplex. 
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[0060] Figure 2 shows a development of the method in Figure 1 for carrying out the check in 
step 108. In order to carry out this check, the vertices of the facet of 5/, on which the intersection 
point xi+\ is located, are firstly determined in step 200. 

5 

[0061] In step 201, a further point is selected from P which is not already a vertex of the facet of 
Si, and which is not collinear with respect to the vertices of the facet. 

[0062] In step 202, a simplex S' is formed from the vertices and the further point from P. 

10 

[0063] In step 203 it is checked whether the simplex S' includes a section of the path [xpc]. If this 
is the case, the further simplex Si+\ which is being searched for is made equal to the simplex S' in 
step 204. This then also answers the question that it is actually possible to form such a simplex 

15 

[0064] If the check in step 203 reveals that the simplex S" does not contain a section of the 
straight line g, in step 205 it is checked whether all the possible points from P have already 
previously been selected in step 201. If this is not the case, in step 201 a further point from P 
which has not yet been previously selected is selected in order to carry out a further iteration of 
20 the method. 

[0065] If it was not possible to find a simplex S/ +1 after "trying out" all the points which are 
possible from P 9 a corresponding item of information is output in step 206. This means at the 
same time, that the point x is outside the convex envelope. 

25 

[0066] In this embodiment it is of particular advantage that in all cases, after a finite number of 
steps, the method indicates whether or not the input data record is in the convex envelope, and 
thus in the working range. 

30 [0067] Figure 3 shows a further embodiment of a method for checking whether an input data 
record is in the convex envelope. This method is not obtained directly from the definition of the 
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convex envelope as a linear combination of the support points. Instead, a different geometric 
property of the convex envelope is used here, and is also illustrated graphically in Figure 4: 
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[0068] If there is a hyper-plane through the point x to be investigated so that all the pieP are on 
one side of the plane, the point x then lies outside the convex envelope formed by P. If there is 
no such plane, the point is in the interior. 

[0069] If the plane is represented by means of the normal vector k, the condition "all points p^P 
lie on one side of the plane" can be expressed as follows: 

h n>0 f i=l...n 



Ti =fi-x being the position vectors of the data points in a coordinate system which has the data 
point to be investigated at the origin. 

15 

[0070] Without restricting the generality, inequality can be interrogated with respect to "greater" 
as the normal vector -k represents the same hyper-plane as k. Points on the facets of the convex 
envelope lead to a scalar product equal to 0 and are thus a component of the convex envelope. 

20 [0071] An optimization method is preferably used for searching for a hyper-plane. 

[0072] Here, the following target function is minimized when the normal vector k varies: 

Fk ' t 
- -mm —r~r 

AM J 

[0073] If the optimum of F is smaller than 0, the point to be investigated lies outside the convex 
25 envelope. For points within the convex envelope it is not possible to find a hyper-plane for which 
F<0 applies. 
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[0074] For the use as an optimization method, various methods are possible, for example the 
MATLAB routine fminsearch as well as gradient methods, Levenberg-Marquard algorithm or an 
evolution strategy which can also be used in combination with local methods. 

5 [0075] An advantage which is significant for the running time behaviour of the algorithm is that, 
if a corresponding hyper-plane has been found for a data point, said hyper-plane also constitutes 
a solution for all the points on the side of the plane lying opposite the convex envelope. If the 
investigation for membership of the convex envelope is to be carried out simultaneously for a 
plurality of data points, the method can thus be considerably speeded up. 

10 

[0076] Figure 3 illustrates this method by reference to a flowchart. In step 300, the input data 
record, that is to say the point jc, is input. 

[0077] In step 301, it is checked by means of one or more of the aforesaid methods, whether 
15 there is a hyper-plane which contains x and for which h r, > 0, / = 1,...,« applies, where k is the 
normal vector of the searched-for hyper-plane, and n is the difference vector between a point /?, 
and x provided by a training input data record. 

[0078] If there is such a hyper-plane, it follows in step 302 that jc is in the convex envelope. In 
20 the opposite case, in step 303 information is output according to which x is outside the convex 
envelope. 

[0079] The check in step 301 to determine whether there is a suitable hyper-plane is illustrated in 
Figure 4. The points /?, located in the grey-hatched area of Figure 4 form a convex envelope 400. 
25 The point x is located outside the convex envelope 400. Between the point x and the points p\ 
there are the difference vectors r, = /?, - jc. 

[0080] A hyper-plane 401, which is described by the normal vector £, runs through jc. As all the 
points pi of the convex envelope 400 are located on the same side of the hyper-plane 400, it 
30 follows from this that x is actually outside the convex envelope 400. 
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[0081] Figure 5 illustrates a further method for checking whether an input data record x is in the 
convex envelope. 

[0082] In this method it is checked whether there is a solution for the equation system which is 
5 obtained from the analytical definition of the convex envelope. 

Equation 2 

^ +... + A„ =1 

[0083] Here, a solution is searched for so that the secondary conditions X\ > 0 are fulfilled. In the 
10 following method, successive attempts are made to achieve this. 

[0084] As in the method in Figures 1 and 2, in this case also an initial solution for 
is assumed for which in general the inequality secondary conditions are not 

fulfilled. 

15 

[0085] Equation 2 is written below in matrix form. Then, 
Equation 3 

20 

is obtained where a line of ones has been added to the vector x and to the dot matrix P* 0) 
respectively. 

[0086] Initialization step 
25 We assume z'=0 and select a random n-dimensional vector 
A {0) = (X U ...,X„) where X\ +...+ X„ = 1 
and Xi > 0. 
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[0087] Iteration step 



[0088] Firstly, we transform the equation 3 by multiplying it on both sides by a matrix M. The 

matrix M is to be selected here in such a way that the lines of the matrix P {l) :=M-P (,) are 
5 ortho-normed (if such a matrix M does not exist, dependent lines in the matrix F® can be 
omitted). In addition, it is assumed that x := M • x . It is not attempted now to solve the equation 

system P (l) Z = x directly but instead we start from the known coefficient vector X {l) and assume 

x (l) := P U) X U) . We then search for a solution of the equivalent equation system 

10 P {i) \x-X {i) )=x-x {i) . 

[0089] As in most cases this equation system is underdetermined, we search for the solution X so 
that ||vi-/l (/) || is minimal (where ||| designates the Euclidean norm). Here, we can make use of 

the fact that the matrix P il) is ortho-normed. The following applies 

15 

X = X»+pw \x-x {i) \ 

[0090] P {l)T being the transponent of the matrix P (l) . If all the components of the coefficient 
vector X which is found in this way fulfil the secondary conditions Xj > 0, a convex linear 

20 combination for the point x has been found, and the point x is therefore in the interior of the 
convex envelope. Otherwise, we set all the coefficients which infringe the secondary condition 
for the rest of the method to zero, and attempt to correct the components which do not infringe 
the secondary condition in such a way that this step is compensated for. In practical terms, this is 
brought about by the fact that all the components which infringe the secondary condition, from 

25 the vector!, and all the associated columns are eliminated from the matrix P . 

[0091] The vector which is obtained in this way with a relatively small dimension and the matrix 
which is obtained in this way with fewer columns are designated by A (,+l) and 
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[0092] For the correction, the (smaller) equation system 



P (M) X =x 

must be solved. To do this, a further iteration step is then carried out, i being increased by one, 
5 this time with X (l+l) as the starting value. If the equation system cannot be solved, there is no 
convex linear combination for the point x and the point is located outside the convex envelope. 

[0093] As at least one column is always eliminated at each iteration step, the method comes to a 
result after a maximum of n steps. 



10 
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[0094] One embodiment of this method is illustrated in Figure 5. 



[0095] In step 500, the index i is set to be equal to zero. In step 501, a starting value for the n- 
dimensional vector X {0) which fulfils the secondary conditions is selected. For this purpose, it is 
1 5 possible to select, for example, X§ = 1/n. 

[0096] In step 502, the matrix M is calculated. On the basis of this, in step 503 the matrix P (i) 
and the vectors x and x {i) are calculated. 

20 [0097] On the basis of this, in step 504, X = X U) + P {if • (x - x (i) ) is calculated. 

[0098] In step 505, it is checked whether all A/(/=l,...,n) of the vector calculated in step 504 are X 
> 0. If this is the case, in step 506, it follows that the point provided by the input data record is 
within the convex envelope. 



[0099] If the opposite is the case, in step 507 all the components of the vector X and the 
corresponding columns matrix P® which infringe the secondary condition are deleted. This 
results in the smaller equation system P {i+x) X = x . 
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[0100] In step 508, the index i is incremented in order to carry out a further iteration of the 
method. 



5 [0101] Figure 6 shows a block diagram of an embodiment of a system 600 according to the 
invention. The system 600 has an input module 601 for inputting an input data record which is 
composed of a=3 parameters in the example considered here. 

[0102] The input module 601 is logically linked to a module 602 which is used for checking 
10 whether an input data record lies within the convex envelope of the neural network 603. This 
checking is carried out, for example, according to a method which is described with respect to 
Figures 1 to 5, or according to another method. 

[0103] The module 602 is logically linked to the neural network 603. If the module 602 
determines that an input data record is in the permitted working range of the neural network 
which is provided by the convex envelope, this input data record is input into the neural network 
603, which then outputs at least one predicted value at its output 604. On the other hand, if the 
module 602 determines that the input data record is not in the permitted working range, a 
corresponding signal is emitted at the output 605, after which no reliable prediction is possible 
for the current input data record. 

[0104] In addition to the neural network 603, the system 600 can also contain further neural 
networks (hybrid model), each of which having in turn arranged upstream of it a module which 
corresponds to the module 602. The results of the individual modules 602 must then be logically 
25 linked to a logic "AND". This ensures that all the neural networks of the hybrid model 600 are 
operated in a permitted working range for a specific input data record of the input module 601. In 
addition, the system 600 can also contain rigorous model components. 
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